C,  H.  Chen 


Electrical  Engineering  Department 
Southeastern  Massachusetts  University 
North  Dartmouth,  Massachusetts  0274? 


'Wiiiltinlhlllll'IlilliWBlIlilliilllilin! 


unciassKted 


1.  .Introduction 

Imago  segmentation  an  image  processing  refers  to  computer 
oriented  techniques  that  partition  the  image  into  meaningful  parts 
or  regions.  It  is  a  major-  function,  of  the  low  level  processing  in 
computer  vision.  A  large  amount  of  research  efforts  has  been 
devoted  to  this  topic  in  the  past  men  years  while  much  more  progress 
is  expected  in  the  next  decade.  Several  good  survey  articles  on 
image  segmentation  have  been  published.  Pu  and  Mui  £ l]  reviewed 
three  major  approaches  to  image  segmentation,  namely,  the  charac¬ 


teristic  feature  thresholding,  edge  detection,  and  region  extrac¬ 
tion.  The  paper  also  provided  97  references s 

So  far  the  image-segmentation  techniques  are  application 
dependent.  A  priori  information  about  the  type  of  images  is  essen¬ 
tial  to  a  successful  segmentation.  For  the  application  in  cytology, 
Ranade  and  Prewitt  [  2]  compared  five  segmentation  algorithms:  two 
of  which  are  histogram  based,  another  two  are  quadtree  based  and 
the  remaining  one  is  the  relaxation  method.  Other  references  include 
the  surveys  by  Zucker  1 3, j  1  and  Rixeman  and  Arbib  [^J  ,  which 
discussed  various  techniques,  and  by  Kanade  J^5|  which  gave  a  unified 
view  of  the  segmentation  problem.  More  complete  list  of  references 
is  in  the  Appendix. 

In  this  brief  report,  research  progress  is  reviewed  according 
to  the  statistically  based  and  the  non-statistically  based  approaches 
to  the  segmentation.  This  dichotomy  ref  _i.©c  us  our  vIgw  xh&x  v 
segmentation  problems  can  be  treated  as  a  statistical  problem 
while  many  others  are  more  suitably  treated  by  the  nonstatistlcal 
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methods  including  the  relational  methods  and  the  syntactic- 
structural  methods.  With  this  view  our  emphasis  is  placed  on  the 
application  independent  and  task  independent  aspects  of  image 
segmentation. 

2s  Statistically-Based  Image  Segmentation 

The  most  familiar  statistical  image  segmentation  procedure  is 
by  thresholding  the  gray  scale  picture.  The  optimal  thresholds 
can  be  determined  or  approximated  statistically.  The  thresholding 
methods  followed  by  other  postprocessing  procedures  such  as:  gap 
filling,  etc.  are  the  most  practical  approach  to  image  segmentation. 
The  next  statistical  segmentation  approach  is  via  spatial  clustering 
which  is  considered  as  an  unsupervised  pattern  classifications  Image 
segmentation  can  be  performed  with  pixel  classification  [6-9]  «.  The 
supervised  segmentation  generally  perforins  better  than  the  unsuper- 
vised  segmentation.  For  the  images  with  additive  noise,  statistical 
boundary  estimation  [lOj  can  provide  region  extraction.  Segmentation 
can  also  be  considered  as  an  estimation  problem  fiijin  which  regions 
are  grown  with  the  aid  of  estimated  parameters.  Furthermore,  the 
homogeneity  and  common  characteristics  of  a  region  can  be  tested 
Statistically  with,  e.g, ,  F-statistic,  K-S  test,  etc. 

Although  contextral  analysis  in  statistical  pattern  recogr.iton 
[12]  is  difficult,  simple  statistical-spatial  models  can  be  very 
effective  in  segmentation.  The  fundamental  .limitation  of  the 
statistical  approaches  is  that  the  image  information  content  is 


not  entirely  statistical  except  for  the  purely  rar 
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Even  for  the  texxured  images  for  whicn  tne  statistical  moaeis  are 
effective,  structural  information  can  be  very  important.  It  is 
necessary  to  develop  a  structural  model  in  some  images  and  estimat 
its  parameters  with  the  aid  of  the  statistical  methods. 

3.  Relational  Approach  to  Image  Segmentation 

In  this  approach,  the  nonstatistical  relationships  are 
established  between  segments  or  regions.  The  segments  can  be  as 
small  as  pixels.  The  best  example  of  the  relational  approach  is 
the  quadtree  structure  proposed  by  Rosenfeld  j 131  •  The  region/ 
edge  coordination  is  performed  locally  so  that  the  noise  points 
which  may  be  present  elsewhere  .in  the  image  have  no  effect  on  this 
coordination.  The  coordination  process  is  important  to  the 
relational  approach  ,in  general.  Semantic  information  can  also  be 
utilized  in  the  relational  approach.  The  relaxation  method  in 
image  segmentation  needs  good  initial  conditions.  The  region 
information  obtained  from  analysis  of  the  histogram  of  the  origina 
image  can  be  us.ed  to  initialize  the  class  membership  indices. 

Such  indices  can  be  probabilistic  relations  to  be  estimated 
recursively. 

4.  Structural-Syntactic  Approach 

The  basic  units  of  structure  in  images  are  primitives. 
Grammatical  rules  can  be  established  such  that  the  image  can  be 
described  by  a  language.  This  formal  approach  in  structural 
analysis  is  called  the  syntactic  approach.  In  general,,  any  method 
which  exploits  the  structure  of  the  images  is  a  structural  approae 


Detection  of  curves*  lines,  etc.  is  a  structural  approach  that  can 
accomplish  image  segmentation.  In  other  images  such  as  the  acous¬ 
tic  ambugv.ity  function,  the  inherent  functional  relation  is  a 
structure  which  is  useful  in.  extracting  the  region  of  interests. 
Thus  the  scope  of  the  structural  approach  is  very  broad.  Obviousl; 
the  statistical  and  the  structural  approaches  should  be  combined 
as  much  as  possible  to  utilise  fully  the  complex  informational 
Content  of  ah  image  so  that  segmentation  can  be  performed  effectiv 
Map or  progress  on  the  structural-syntactic  approach  to  image 
segmentation  has  been  reported  recently  at  the  Saratoga  Springs 
Workshop  fi4|  ,  The  fundamental  problem  is  the  primitive  selection 
which  does  not  appear  to  have  a  formal  solution.  A  feedback  link 
has  been  suggested'  that  allows  the  re-selection  of  primitives  afte 
making  the  decision  based  on  the  original  primitives. .  Another 
interesting  procedure  Suggests  the  joint  use  of  the  local  and  the 
global  procedures.  These  directions  remain  to  be  explored. 
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